International Journal of Technological Exploration and Learning (IJTEL) 
Volume 2 Issue 4 (August 2013) 




Integer Wavelet Transform and Predictive Coding 
Technique for Lossless Medical Image Compression 



Vineeta Gupta A.G. Rao 

M.Tech Scholar, Electronic Design and Technology Scientist-B, Electronic Design and Technology 

National Institute of Electronics & Information Technology National Institute of Electronics & Information Technology 
Gorakhpur ,U.P. Jndia Gorakhpur ,U.P. Jndia 



Krishna Mohan Pandey 

MATLAB Trainer, Cetpa Infotech Pvt. Limited 
Lucknow ,U.P. Jndia 



Abstract — Lossless image compression has one of its important 
application in the field of medical images. Enormous amount of 
data is created by the information present in the medical images 
either in multidimensional or multiresolution form.Efficient 
storage, transmission, management and retrieval of the 
voluminous data produced by the medical images has nowadays 
become increasingly complex. Solution to the complex problem 
lies in the lossless compression of the medical data .Medical data 
is compressed in such a way so that the diagnostics capabilities 
are not compromised or no medical information is lost.This paper 
proposes a hybrid technique for lossless medical image 
compression that combines integer wavelet transforms and 
predictive coding to enhance the performance of lossless 
compression. Here we will first apply the integer wavelet 
transform and then predictive coding to each subband of the 
image obtained as an output to lifting scheme.Measures such as 
entropy,scaled entropy and compression ratio are used to 
evaluate the performance of the proposed technique. 

Keywords- Lossless Compression; Integer Wavelet 
Tranform; Predictive Coding; Medical Image, entropy. 

I. Introduction 

Recent developments in health care practices and 
development of distributed collaborative platforms for medical 
diagnosis have resulted in the development of efficient 
technique to compress medical data. Telemedicine applications 
involve image transmission within and among health care 
organizations using public networks. In addition to 
compressing the data, this requires handling of security issues 
when dealing with sensitive medical information systems for 
storage, retrieval and distribution of medical data. Some of the 
requirements for compression of medical data include high 
compression ratio and the ability to decode the compressed data 
at various resolutions. 

In order to provide a reliable and efficient means for storing 
and managing medical data computer based archiving systems 
such as Picture Archiving and Communication Systems 
(PACS) and Digital-Imaging and Communications in 



Medicine (DICOM) standards were developed. Health Level 
Seven (HL7) standards are widely used for exchange of textual 
information in healthcare information systems. With the 
explosion in the number of images acquired for diagnostic 
purposes, the importance of compression has become 
invaluable in developing standards for maintaining and 
protecting medical images and health records. 

There has been a lot of research going on in lossless data 
compression. The most common lossless compression 
algorithms are run-length encoding, LZW, DEFLATE, JPEG, 
JPEG 2000, JPEG-LS, LOCO-I etc. Lempel-Ziv-Welch is a 
lossless data compression algorithm which can be used to 
compress images . The performance of LZW can be enhanced 
bOy introducing three methods. The first two methods eliminate 
the frequent flushing of dictionary, thus lowering processing 
time and the third method improves the compression ratio by 
reducing number of bits transferred over the communication 
channel. JPEG is most commonly used lossy compression 
technique for photographic images which can be converted into 
lossless by performing integer reversible transform. Lossless 
compression in JPEG [7] is achieved by performing integer 
reversible DCT (RDCT) instead of the floating point DCT used 
in original JPEG on each block of the image later using lossless 
quantization. Lossless JPEG does not allow flexibility of the 
code stream, to overcome this JPEG 2000[l-2] has been 
proposed. This technique performs lossless compression based 
on an integer wavelet filter called biorthogonal 3/5. JPEG 2000 
s lossless mode runs really slow and often has less 
compression ratios on artificial and compound images. To 
overcome this drawback JPEG-LS [6] has been proposed. This 
is a simple and efficient baseline algorithm containing two 
distinct stages called modeling and encoding. This technique is 
a standard evolved after successive refinements as shown in 
articles [3], [4], and [5]. JPEG-LS algorithm is more scalable 
than JPEG and JPEG 2000. 

II. LOSSLESS IMAGE COMPRESSION MODEL 

Many image compression algorithms use some form of 
transform coding. Fig. 1 shows a block diagram of encoder and 
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decoder using transform coding. The first step is to obtain a 
mathematical transformation to the image pixels in order to 
reduce the correlation between the pixels. The result of the 
transform is known as the transform coefficients. After this 
step, in lossy compression, an explicit quantizer may be used, 
or an implicit quantizer such as the truncation of the bitstream 
may be used. The source of the data loss in image compression 
is the quantizer. Thus, in the lossless compression case, the 
quantizer is not used. The third step is coefficient coding, 
which means that the transform coefficients are reorganized in 
order to exploit properties of the transform coefficients and 
obtain new symbols to be encoded at the fourth step. For 
example, the transform coefficients can be considered as a 
collection of quad-trees or zero-trees [8] [9] and or treated in a 
bit plane fashion,so as to provide scalability to the compressed 
bitstream. The symbols from the coefficient coding are 
losslessly compressed at the entropy coding step. Entropy 
coding can be any method capable of compressing a sequence 
of symbols, such as Huffman coding [10], arithmetic coding 
[11] and Golomb coding [12]. 
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Figure 1 . Block Diagram of an Encoder and Decoder using Transform 
Coding. 

ITT. LOSSLESS COMPRESSION CODING TECHNIQUES 

In this section different coding techniques used to achieve 
lossless compression are discussed. The primary encoding 
algorithms used to produce bit sequences are entropy coding 
techniques of which the most efficient are Huffman coding 
(also used by DEFLATE) and arithmetic coding. We also go 
over lossless predictive coding technique. 

A. Entropy Coding 

Entropy measures the amount of information present in the 
data or the degree of randomness of the data. After the data has 
been quantized into a finite set of values it can be encoded 
using an entropy coder to achieve additional compression using 
probabilities of occurrence of data. This technique reduces the 
statistical redundancy. The entropy coder encodes the given set 
of symbols with the minimum number of bits required to 
represent them. It is a variable length coding which means that 
it assigns different number of bits to different gray levels. If the 
probability of occurrence is more, then fewer bits/sample will 
be assigned. 

ENTROPY (H): Suppose we have M input levels or 
symbols (SI, S2...SM) with their probabilities (PI, P2...., PM) 



H = - £k=i Pklog 2 P k = ZkU Pklog 2 (1/P k ) 

In the least random case it takes only one value where 

H = 




Most randomcase: 



H = log 2 M 



The average number of bits per pixel needed with Huffman 
coding is given by 

R = Zk=i Pk n k 

Where P k represent the probabilities of the symbols and Nk 
represent the number of bits per the code generated. Coding 
efficiency (yf) can also be calculated using H and R generated 
earlier 



H 



100 



B. Huffman Coding 

Huffman coding is an entropy coding algorithm which is 
used in lossless compression. In this technique the two smallest 
probabilities are combined or added to form a new set of 
probabilities. This uses a variable length code table which is 
based on the estimated probability of occurrence for each 
possible value of the source symbol. This is developed by 
David. A. Huffman. In Huffman coding each symbol is 
represented in a specific method which expresses the most 
common characters with fewer strings than used for any other 
character. Huffman coding is equivalent to simple binary block 
encoding. Although Huffmans original algorithm is optimal for 
a symbol-by-symbol coding (i.e. a stream of unrelated 
symbols) with a known input probability distribution. It is not 
optimal when the symbol-by-symbol restriction is dropped, or 
when the probability mass functions are unknown, not 
identically distributed, or not independent. 

The basic technique involves creating a binary tree of nodes 
which can be finally stored as an array. This size depends on 
the number of symbols which have given probabilities. Now 
the lowest two probabilities will be added and one probability 
will be represented by „0" and the other probability which is 
added will be assigned a „1". This process is repeated until all 
the additions are completed leaving a sum of one. The simplest 
construction algorithm uses a priority queue where the node 
with lowest probability is given highest priority. The 
performance of the method is calculated using entropy . 

IV. INTEGER WAVELET TRANSFORM 

The wavelet transform generally produces floating-point 
coefficients. Although the original pixels can be reconstructed 
by perfect reconstruction filters without any loss in principle, 
the use of finite-precision arithmetic and quantization prevents 
perfect reconstruction. The reversible IWT (Integer Wavelet 
Transform), which maps integer pixels to integer coefficients 
and can reconstruct the original pixels without any loss, can be 
used for lossless compression [13] [14] [15] [16]. One 
approach used to construct the IWT is the use of the lifting 
scheme (LS) described by Calderbank et al. The IWT 
construction using lifting is done in the spatial domain, 
contrary to the frequency domain implementation of a 
traditional wavelet transform [16] [17]. 

Wavelet transforms have proven extremely effective 
for transform-based image compression. Since many of the 
wavelet transform coefficients for a typical image tend to be 
very small or zero, these coefficients can be easily coded. Thus, 
wavelet transforms are a useful tool for image compression. 
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The main advantage of wavelet transforms over Oother 
more traditional decomposition methods (like the DFT and 
DCT) is that the basis functions associated with a wavelet 
decomposition typically have both long and short support. The 
basis functions with long support are effective for representing 
slow variations in an image while the basis functions with short 
support can efficiently represent sharp transitions (i.e., edges). 
This makes wavelets ideal for representing signals having 
mostly low-frequency content mixed with a relatively small 
number of sharp transitions. With more traditional transforms 
techniques like the DFT and DCT, the basis functions have 
support over the entire image, making it difficult to represent 
both slow variations and edges efficiently. 



V. LIFTING SCHEME 

The simplest lifting scheme is the lazy wavelet transform, 
where the input signal is first split into even and odd indexed 
samples. 

( oddj_! ,evenj.! ) = Split(sj ) 

The samples are correlated, so it is possible to predict odd 
samples from even samples which in the case of Haar 
transform are even values themselves. The difference between 
the actual odd samples and the prediction becomes the wavelet 
coefficients. The operation of obtaining the differences from 
the prediction is called the lifting step. The update step follows 
the prediction step, where the even values are updated from the 
input even samples and the updated odd samples. They become 
the scaling coefficients which will be passed on to the next 
stage of transform. This is the second lifting step. 



s j-i : 



: oddj_! - P(even j.i ) 
= even yi + U(dj_i) 



Finally the odd elements are replaced by the difference and 
the even elements by the averages. The computations in the 
lifting scheme are done in place which saves lot of memory and 
computation time. The lifting scheme provides integer 
coefficients and so it is exactly reversible. The total number of 
coefficients before and after the transform remains the same. 
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Figure 2. Forward Lifting Scheme 

The inverse transform gets back the original signal by 
exactly reversing the operations of the forward transform with a 
merge operation in place of a split operation. The number of 
samples in the input signal must be a power of two, and these 
samples are reduced by half in each succeeding step until the 
last step which produces one sample. 



Finally 



Even,.! = Sj_i -U(dj_,) 
Oddj.! = dj_! + P(Even j _ 1 ) 
Sj = Merge(Evenj_i , Oddj.i ) 
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Figure 3 . Inverse Lifting Scheme 



The Haar wavelet transform uses predict and update 
operations of order one. Using different predict and update 
operations of higher order, many other wavelet transforms can 
be built using the lifting scheme. 
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Figure 4. Steps for Decomposition Using Lifting 

Basic steps involved in the decomposition are illustrated in 
Fig. 4 Firstly the image/signal is sent through a low pass and 
band pass filter simultaneously (predict and update in case of 
lifting) and down sampled by a factor of 2. The process is 
repeated and the final four outputs are combined to from the 
transformed image as shown in Fig. 5 




L 


LH 


HL 





Original Image 



Transformed Image 



Figure 5. Input and Outputs of Lifting Scheme 

The transformed image in Fig. 5 shows different sub bands 
of which the first sub band is called LL which represents the 
low resolution version of the image, the second sub band is 
called LH which represents the horizontal fluctuations, the third 
band is called the HL which represents the vertical fluctuations, 
and the fourth sub band is called the HH which represents the 
diagonal fluctuations. Same procedure can be followed to 
obtain different levels of image decomposition by changing the 
inputs given to the lifting or filter bank implementation 
techniques. 

VI. INTRODUCTION TO PREDICTIVE CODING 

The prediction technique computes the weighted 
differences between neighboring pixel values to estimate the 
predicted pixel value. The prediction error is decomposed by a 
one-level integer wavelet transform to improve the prediction. . 
The differences are taken between the original sample and the 
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sample(s) before the original sample. Let f (n) be the original 
sample then the difference d (n) will be given by 

d(n) =f(n)-f(n-l). 




Figure 6. Original Histogram 




Figure 7. Histogram of the difference 

Fig. 7 shows that it is easier to encode the difference rather 
than encoding the original sample because of less dynamic 
range. 



Predictor 



Rounding — 



Entropy 
Coder 



/(n) 



Figure 8. Predictive Encoder 

Generally, the second order predictor is used which is also 
called Finite Impulse Response (FIR) filter. The simplest 
predictor is the previous value, in this experiment the predicted 
value is sum of the previous two values with alpha and beta 
being the predictor coefficients. 

/(n)=<f(n-l)> 




Rounding 




Predictor 









In the process of predictive coding input image is passed 
through a predictor where it is predicted with its two previous 
values. 

/(n) = a*f(n-l) + P*f(n-2) 

/(n) is the rounded output of the predictor, f(n-l) and f(n- 
2) are the previous values, a and P are the coefficients of the 
second order predictor ranging from to 1 . The output of the 
predictor is rounded and is subtracted from the original input. 
This difference is given by 

d(n) =f(n)-/(n) 

Now this difference is given as an input to the decoder part 
of the predictive coding technique. In the decoding part the 
difference is added with the f A (n) to give the original data 

f(n)= d(n) + /(n) 

VII. IMPLEMENTATION AND EXPERIMENTAL RESULTS 

In this report the Integer Wavelet Transform (IWT) and the 
Predictive Coding Techniques are used to perform lossless 
image compression. The performance of the proposed 
techniques is calculated by finding the Entropy and scaled 
entropy of the compressed image. The performance is also 
measured using compression ratio which is given by the ratio 
of the bits in the original uncompressed data to the number of 
bits in the compressed data. 

A. Procedure 

The procedure of the implementation involves two methods 
of performing compression on the medical image. In the first 
method IWT is performed first followed by predictive coding. 
The procedure of the implementation involves two methods of 
performing compression on the medical image. In the first 
method IWT is performed first followed by predictive coding 
technique on the transformed image. The second method 
involves reduction of the filter coefficients by a factor of 3/2 
and then applying integer wavelet transform followed by 
predictive coding technique. All these methods use Haar filter 
in the lifting scheme and the filter coefficients are given by: 

hl= [-1 9 9 1]/ (16); 
h2= [0 1 l]/(-4); 
Where hi are the prediction filter coefficients and h2 are 
the update filter coefficients in the lifting scheme. 

The reduced filter coefficients are given by 

hl= [-19 9 1]/ (16*1.5); 
h2= [0 1 1]/ (-4*1.5); 

B. Implementation using Methodl 
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Figure 9. Predictive Decoder 



Figure 10. Block Diagram for IWT Followed by Predictive Coding 
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In this method integer wavelet transform is applied on the 
image which divides the image into four subbands ss, sd, ds, 
dd. Now predictive coding is applied on the four different 
bands separately giving outputs dl, d2, d3 and d4. The 
reconstruction process involves applying the predictive 
decoding followed by inverse integer transform. The 
reconstructed image is represented by z. To verify the perfect 
reconstruction the original and the reconstructed images are 
subtracted and the output is a dark image with maximum and 
minimum values as zero 

C. Outputs of Methodl 




Figure 1 1 . Original image of Mri of Ankle 




Figure 12. Image obtained after subband coding 




Figure 13. Encoded Image 





















Figure 14. Decoded image 























Figure 15. Reconstructed image 




D. Implementation using Method2 

In this method the filter coefficients used in the integer 
wavelet transform using lifting scheme are reduced by a factor 
of 3/2 and the same steps mentioned in Section VITB are 
performed. 



E. Outputs of Method2 




Figure 18. Image obtained after subband coding 




Figure 19. Encoded Image 




Figure 20. Decoded image 



Figure 21. Reconstructed image 




Figure 22. Difference between original and reconstructed image 




IV. CONCLUSION 

This paper presented two different methods for lossless 
medical image compression and these methods are tested using 
four different medical images of 256x256. The images are 
compressed losslessly by performing integer wavelet transform 
using lifting technique as mentioned in the report of 



Figure 16. Difference between original and reconstructed image Daubechies and Wim Sweldens and lossless predictive coding 

technique using second order predictors. Lifting is achieved by 
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performing simple filtering steps using finite filters such as 
Haar filter. In all our methods we have used first order Haar 
filter for performing lifting. In lossless predictive coding 
technique we take the difference or prediction error into 
consideration rather than taking into account the original 
sample/image, the differences are taken between the original 
sample and the sample(s) before the original sample as it is 
easier to encode the difference rather than encoding the original 
sample. 

In the first lossless compression method, the image is 
transformed into four subbands using lifting technique, then 
predictive coding is applied to each subband using different 
predictor coefficients alpha and beta, giving an encoded image 
as output. Entropy and scaled entropy are used to calculate the 
performance of the system, which calculates the number of bits 
per pixel. A lower entropy and scaled entropy indicate higher 
performance of the system. 

The analysis of the experimental results has given many 
conclusions. Choosing the predictor coefficients is more critical 
as the alpha and beta value can lie between and 1 , so different 
combinations of these coefficients are tested. The best 
combination in methods 1 and 2 are ( 0.01, 0.01 ) & (0.9,0.9) 
respectively has been highlighted in the table 1 & 2. 
Compression ratio for different medical images have been 
calculated and have been listed in table5. Among the two 
methods, the second method of performing integer wavelet 
transform followed by predictive coding using the reduced 
filter coefficients gave a better compression. Fig.23 (See 
Appendix) shows the comparison of minimum entropy for 
method 1 and method 2 using different values of alpha and 
beta. Out of all the medical images used the mri of ankle give 
the minimum entropy using method 1 and using method 2 the 
nasal fracture gave the least entropy .These results can be seen 
from the graphs plotted in Fig. 24 (See Appendix). 
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APPENDIX 



TABLE I. Tabulations of Method 1 using different values of alpha and beta 



S.NO. 


ALPHA 


BETA 


ORIGINAL 


ENTROPY 


ENTROPY AFTER 


SCALED 








ENTROPY 


AFTER IWT 


PREDICTIVE CODING 


ENTROPY 


1 


0.1 


0.1 


0.9494 


0.9619 


0.9407 


0.5473 


2 


0.3 


0.3 


0.9494 


0.9714 


0.9908 


0.7117 


3 


0.5 


0.5 


0.9494 


0.9154 


0.9999 


0.8866 


4 


0.7 


0.7 


0.9494 


0.9004 


1.0000 


0.8191 


5 


0.9 


0.9 


0.9494 


0.9237 


0.9998 


0.8008 


6 


0.1 


0.01 


0.9494 


0.9569 


0.9139 


0.5185 


7 


0.01 


0.1 


0.9494 


0.9571 


0.9138 


0.5211 


8 


0.01 


0.01 


0.9494 


0.9496 


0.8754 


0.5021 
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TABLE II. 



Tabulations of Method 2 using different values of alpha and beta 



S.NO. 


ALPHA 


BETA 


ORIGINAL 
ENTROPY 


ENTROPY 
AFTER IWT 


ENTROPY AFTER 
PREDICTIVE 
CODING 


SCALED 
ENTROPY 


1 


0.1 


0.1 


0.9494 


0.8684 


0.8901 


0.6669 


2 


0.3 


0.3 


0.9494 


0.9896 


0.5299 


0.7805 


3 


0.5 


0.5 


0.9494 


0.7401 


0.3815 


0.7082 


4 


0.7 


0.7 


0.9494 


0.5278 


0.3446 


0.5164 


| 


0.9 


0.9 


0.9494 


0.4481 


0.3294 


0.4364 


6 


0.1 


0.01 


0.9494 


0.8446 


0.9333 


0.6557 


7 


0.01 


0.1 


0.9494 


0.8464 


0.9323 


0.6584 


8 


0.01 


0.01 


0.9494 


0.8289 


0.9587 


0.6554 



TABLE III. 



Comparison Table for different images using method 1 



IMAGE 


ORIGINAL 
ENTROPY 


ENTROPY AFTER 
INTEGER WAVELET 
TRANSFORM 


ENTROPY AFTER 
PREDICTIVE 
CODING 


SCALED 
ENTROPY 


MRI OF ANKLE 


0.9494 


0.9496 


0.8754 


0.5021 


MRI OF BRAIN 


0.8953 


0.8967 


0.9572 


0.6036 


IRIS OF EYE 


0.9994 


0.9996 


0.9729 


0.6026 


NASAL FRACTURE 


0.8773 


0.8773 


0.9871 


0.6467 



TABLE IV. 



Comparison Table for different images using method 2 



IMAGE 


ORIGINAL 
ENTROPY 


ENTROPY AFTER 
INTEGER WAVELET 
TRANSFORM 


ENTROPY AFTER 
PREDICTIVE 
CODING 


SCALED 
ENTROPY 


MRI OF ANKLE 


0.9494 


0.4481 


0.3294 


0.4364 


MRI OF BRAIN 


0.8953 


0.5222 


0.4480 


0.5149 


IRIS OF EYE 


0.9994 


0.5876 


0.4893 


0.5652 


NASAL FRACTURE 


0.8773 


0.3713 


0.3145 


0.3684 
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Comparison of Entropy's of method 1 and method 2 using different alpha and beta 
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Figure 23. Graph between predictors and scaled entropy for method 1 and method 2 
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Comparison of different medical images for all the two methods 
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Figure 24. Comparing the behavior of different medical images (256x256) 
TABLE V. Compression Ratio of different Medical Images 



IMAGE 


PIXELS 


COMPRESSION 
RATIO 


MRI OF BRAIN 


256X256 


1.061 


MRI OF ANKLE 


256X256 


1.097 


IRIS OF EYES 


256X256 


1.508 


NASAL FRACTURE 


256X256 


1.098 
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